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A FOUR VALUE PERSONNEL DECISION MODEL: REMEDIAL PLACEMENT 

Robert F. Boldt 
Educational Testing Service 

Abstract 

The personnel decision principally treated in this paper is that of 
remedial placement. The decision made with respect to candidates is to 
accept or reject, and performances by candidates are evaluated as pass or 
fail. A criterion and a selection variable were assumed, and t.ie problem 
is to choose a cutting score on the selection variable such that the value 
of acceptance decision-outcome combinations is at an optimum. Optimisation 
conditions are given in general functional notation and for normal surfaces . 
Nimierical examples are given for three philosophies of evaluating pass and 
fail outcomes and for three levels of college course difficulties. 
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\ FOUR VALUE PERSOMiEL DECISION MODEL:. REMEDIAL PLACSMEOT^ 

Robert F. Boldt 
Educational Testing Service 

In contrast to the highly selective institutions which catered to the 
elite of another era^ many institutions exist -t-^day which "meet the student 
at his level." Rather than being academicall'^ oriented with highly selective 
admissions standards ^ these institutions minimize admissions rec^uirements ^ 
choosing to guide the less able student into curricula which are appropriate 
for his skills, abilities, and interests, and to remedy background deficiencies 
he may have when such seems desirable in view of the path the student has 
planned for himself. Thus the guidance counselor and the student are faced 
-^ith the decision as to whether some experience is needed which is aimed at 
remedying the effects of perhaps inadequate focus on academic skills, partic- 
ularly in English and mathema .ics . The decision as to whether some remedial 
training is needed may be made in a variety of ways, and one common one is 
on the basis of scores obtained from orientation testing. 

The problem of reaching this type of decision is not new. Many authors 
have discussed the assessment of personnel processes which d^ pr ' ::ho 

metric evaluation. The discussions and evaluations may be complicated by the 
need for externally generated information about the worth of a personnel 
action. Though most authors have of necessity made their evaluations in 
terms of criteria which are immediately observable, even if not based on 
ultimate values, some have been concerned with more remote criteria (Brogden, 
I9k9; Brogden & Taylor, 1950; Cronbach & Gleser, 1965)- Certainly, for the 
last three decades the systems analysts have been aware that the relative 
excellence of performance of some particular task by personnel is not to be 
equated to a contribution to the performance of a total system. In fact, it 




3 



- 2 -. 



is probably only the simplest of systems in which it is possible to make a 
believable and direct connection between individual performance and system 
performance^ contribution to society^ or whatever the purpose of the system 
is wiuhin which the personnel process exists • Indeed, the most complex 
models of human performance have been constructed in the context of man- 
machine interactions, the most complicated of the complex being developed for 
control systems such as aircraft or fire control systems (e.g., Machol, Tanner, 
& Alexander, 19^5, Ohs 32-34-, pp, 31-36), where the connection between himaan 
response and system performance is most directly and easily comprehended. 

In extremely complex systems such as the large military, industrial, or 
educational organizations, the tie between individual and system performance 
is quite often not apparent. In fact, an organizational action may be com- 
plex and multivalued and even may be partly evaluated on the basis of the 
effects on the individuals who perform within it, as in educational systems. 

The problem becomes confusing beyond measure and yet one acquires the 
notion, and the experience to back it up, that somr ir " /idua' .udiic 

are better than others in oerms of organizational output, or at least that 
soiree are clearly satisfactory and others are clearly not. One might, the„_... 
approach the problem of evaluating performances in complex situations by 
usdng only a f o «r vabaes reflecting a limited number of states of the persxjnncl 
system. Such an appiroach has pr:-:cedent (Berkson, 194-75 Brown, 1930 5 Bunczm 
et al., 19535 Taylor 8c Russell, 1939)- For some purposes it is sufficient... 
and in some senre more meaningfui, to think about situations v/here persomie ■. 
decisions are of an accept -r eject sort and criterion perfonnar.ces are of 
]^ass-fail sort. Hence, outcoimes are evaluated for four situ, t: ions only, 
aecept-pass, accept-fail, re^ set -pass , and reject-fail. High passes woui_d be 
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evalLuated the same as near failures and low failures would be evaluated the 
same as near passes (if such distinctions exist)* 

In the remedial situation, a large group of incoming students is tested 
to determine who is prepared for academic competition at the college level 
and who should receive special treatment. It is taken for granted that the 
testing will occur and hence the cost of testing is not a factor. This paper 
will not consider differential costs of remedial as opposed to regular course 
work except insofar as they might be incorporated in evaluating the fo*ur out- 
comes listed above. Rather, the problem here is to set a cut score for 
dete .mining who gets remedial treatment and who goes on to regular collegiate 
work. 

In the theoretical scheme, it is assumed that one is dealing with a 
"candidate pop'ulation" each member of which is to be "accepted" or "rejected." 
Decisions to "accept” .or "reject" are, in the context of decisions about 
remedr^.al raining^ to allow entry into a regular academic ciorriculum or to 
require makeup work of some kind. They are to be based on a "selection 
variable.," x . 3i}valuation of the outcome of a decision is based on a 
criterion variable" which is evaluated as "pass" or "fail." Here, passing 
anH failing refer to the quality of performance in a regular college course. 

Development of the Cut Score 



It is assumed that the Joint distribution of the selection variable, x 
and the criterion variable, y , is known and is denoted f(x,y) Let c 

be a cut score on the criterion variable such that a pass occurs if y > c , 

y 

failure otherwise. .Let c be the cut score sought such that if x > c . 

acceptance occurs, r^^Jection (route to remedial) otherwise. In Figure 1 the 
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selectiion variable^ x ^ is represented by the ‘-abscissa- and a criterion 
variable, y , is represented by the ordinate- Then the dotted line whose 
equation is x = c divides accept ees to the right fi’om rejectees to the 
lert. The dotted line whose equation is y = c^ divides passers abo\'e 
from failures below. Greek symbols in Figure 1 are included to clarify the 
regions of integration in the definitions immediately below. 

Then 



cc(c ) = / / f(x,y)dydx , is the proportion of selected passers, 
X y 



P(c^) » 



y 



f(x,y)dydx , is the proportion of selected failures. 



X 

“ r 



7(c^) = j J f(x,y)dydx , is the ‘proportion of rejected passers. 



- ooc 



y 



and 



c c 



5(c^) = J f‘(x,y)dydx , is the proportion of rejected 



failirres . 



Since the proper choice of the cut score on the selection variable, c^ , is 
the concern of this discussion, notation is used which indicates that a , p , 
7 , and b are all functions of c^ . Note also that in Figure 1 both Roman 
and Greek letters appear. The Roman letter is the symbolic representation of 
the gain or cost of a case which falls in the area associated with a Greek 
letter. Let 

a be the gain from selecting a passer, 
b be the cost of selecting a failure, 

O 
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g “be the cost of* rejecting a passer, and 
d be the gain from rejecting a failure. 

It is assumed that a , b , g , and d are real, nonnegative numbers, con- 
stants of the system and hence not functions of the cutting score. The 
numerical values of these constants, or certain relations among them, must 
somehow be determined if an optimal cut score is to be set. 

Neglecting a constant for the number of people involved, 

( 1 ) V(c ) = aa(c ) - bp(c ) - gr(c ) -f- d&(c ) 

A. A. A. 



is the value of a set of acceptance decisions using c as the cut score on 
the selection variable. One may note from the definition of 7 and 
that if 7 + 6 , the proportion of persons to receive remedial course work, 
is fixed, c is fixed and hence V does not enter into choice of c 
Bather, with a fixed quota for remedial courses one merely rejects cases on 
X starting from the bottom and going up. If one does not have a fixed 
quota system, one chooses c^ by maximizing V . To do this, differentiate 
equation (l) with respect to c^ to obtain 



X ' X 



y 



dV(c^)/dc^ = -a / f(c^,y)dy + b / f(c^,y)dy - g / f(c^,y)dy + dj f(c^,y)dy 



X 



y 



y 



-a r f(c^,y)dy +bf f f{c^,y)dy-J' f(c^,y)dyj 
C M C ' 

y y 



CX5 00 DO 

- g r f(c^^y)dy + d^ f(c^,y)dy -J f(c^,y)dy^ 
y " ^y 

00 TO 

= (b + d) J t{c^,y)dy - (a+b+g+d) J f(c^,y)dy 
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Equating dv(c )/dc to zero yields 

X X 



( 2 ) 



(t 






= (a + "b + 



+ f (c^^y)<3y 

y 



Thus a maximum of exists at that array of* x where the relationship 

( 2 ) obtains between the proportion in the array that pass and the costs and 
values (provided such an array exists). Note that the integral on the lefti- 
hand side of equation (2) yields the marginal density oT x at c . IT 
one divides (2) by this marginal density and solves for the resulting con- 
ditional density^ one obtains 



(5) 



P(pass[c^) = (b + d)/(a + b + g + d) 



or 



(4) P(faillc^) = (a + g)/(a + b + g + d) 

as the condition required to maximize V(c ) . 

2C 



Application to the Normal Case 



Suppose that in the candidate population x and y are jointly normally 
distributed. Then P(pass |c^) the integral of the normal probability 

function from a lower bound 



(5) 






where the p *s^ cr and p are the usual parameters of the bivariate 
normal distribution. Knowing the right-hand side of equation (3) or (4)^ 
the required value of B can be gotten from the normal tables . The value 
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of c must be estimated, at least in standard score form, from one's 

y 

ledge of the difficiilty of the college com''se. Then^ kno^T'ing the values 
of the parameters of the Joint distribution of x and y , the optimal 
value of can be found by substituting all the known values into 

equation (5) and solving for - 

For illustration^ three evp.luations uf the outcome of placement are 
considered. The first evaluation^ in which the emphasis is on avoiding 
failure^ would, suggest the assumption that 2a = d and 2g = b - In this 
evaluation^ the left side of equation (?) becomes 

(b + d)/(a 4 b + g + d) = (2a -t- 2g)/(a 4 2g 4 g 4 2a) = 2/3 ^ 

and B = -.45 - The second evaluation^ one in which neither the costs of 
incorrect decisions nor the costs of correct decisions can be discriminated^ 
would suggest assumptions of indifference, that is, a = d and g = b . 

In this evaluation, the left side of equation (3) becomes 

(b 4 d)/(a 4 b 4 g 4 d) ^ (b 4 d)/(b 4 d4 b 4 d) ~ l/2 

and B = 0 . The third evaluation, one in which the emphasis is on detecting 
potential passers, would suggest the assuimptions that a = 2d and g = 2b . 
In this evaluation, the left side of equation (3) becomes 

(h + d)/(a 4b4g4d) = (b4 d)/(2d 4 b 4 2b 4 d) = l/3 

and B = .45 - 

To further the illustration, three levels of difficulty will be assumed 
for the criterion (college level course): An easy one such that 80^ of the 

candidates lie above c^ (would pass), one of middle difficulty such that 
half the students would pass the course, and a hard course where only 20fo 
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of the candidates would pass . With th^ asstimptions that have been 

made, expressed in standard score e^eXs “-.8if for the easy course, 

zero for the course of middle difficult/^ for the hard course. 

Using the three evaluations of Of Placement, the three diffi- 
culties of the college level course, as^\;5-n^ is in standard score 

form, and that p = .6 , six sets of va^J-%^ h^ substituted in equation 

( 5 ) to obtain six cut scores. The cut i'of the situation where the 

desire to avoid failure predominates aix^ ^oJ'iege course is easy is 

gotten by substituting into equation ( 5 ) 

(6) -.43 = (-.84 - .6 

where c is assumed to be in standard Solving for c yields 

X ^ 

about -.83 which, using normal tables, that about QO% of the 

students should be let in the college llowever^ if one emphasizes 

the detection of passers, the substiti;t'i^p in equation (3) yields 

(7) A3 = (-.84 - .6 ^ 

which when solved for c^ yields about implies an acceptance rate 

of about ^Qio. If the hard college cour^^ U^iUg Used, the -.84 in 

equations (6) and ( 7 ) would be replaced if the intermediate position 

on evaluation were adopted the left-han^ 0^* equations (6) and ( 7 ) would 

be zero. 

The six sets of results are summar:J"^^d in i’able 1. Note that the cut 
score or the percent accepted are stroh^iy f^la'^ed to the difficulty of the 
college course. It is believed that tl^ placement situation is one 

in which most people would pass the coli^^g^ OOUfSe and hence line items (l). 






(4) and ( 7 ) are the ones of concern here. Examination of these line items 
suggests that under the present assumptions very few students would be 
given remedial training unless the desire to avoid failures is much stronger 
than that to detect passers. Certainly, the results of Table 1 emphasize 
the effect of course difficulty and the evaluation of outcomes on remediation 
policy. 

Insert Table 1 about here 



Use of the Cumulative Distribution 

Equations ( 5 ) and (4) indicate that the cut score, c , should be chosen 

X 

using the arrays of y for given levels of x - In practice these arrays may 
not be usable since only a few scores may be near enough to x to use in an 
array. One would prefer to use the more stable cumulative distributions. Such 
a use may be Justified considering that it is usually reasonable to believe that 
P(pass|c ) is monotonically increasing with c , i.e., if v < c , then 

X X 

P(pass [v) < p(pass|c^) 

Then if Q(pass|c ) is the proportion of all cases at c or below that 

X X X 

would pass, 

Q(pass|c^) < P(pass|c^) . 

Hence ^ using equation ( 5 ) the value of x for which Q, equals 
(b + d)/(a + b + g + d) is an upper bound for c^ . Given admittedly 
grossly approximate estimates of a , b , g , and d one might well be 
willing to use Q to find c^ using some judgmental adjustment. 
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Summary 

The present paper deals with a personnel situation characterized by a 
candidate pool of fixed size^ each member of which is to be accepted or 
rejected on the basis of a selection variable. The outcome of performance 
if accepted is either pass or fail. All accepted passers are considered 
equivalent as are accepted failures, rejected failures, and rejected passers 
though the value of any one of tie out. may be different fror . any other, 

n objective function is developed for evaJLr^ating cut scores and conditions 
_or choosing or a::;proximating an optimuir. c".-t score are presented. Examples 
are given under conditions of Joint normal .oy and it is found that the 
rejection rate is large only when one is highly concerned about failure. 

The model was developed with remedial placement in English and mathematics 
in mind. 
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Foot notes 

^This research was supported in part by the College Entrance Exe’^'i nation 

Board. 

2 

Note that f(x,y) is the joint distribution of the selection - riable 
and the criterion variable in the candidate pool . Such a distribution 
cannot be observed in practice unless the means of reaching acceptance 
decisions at the time of a study are unrelated to the selection variable 
used in the study . Possibly some appeal to range restriction theory 
(Gulliksen, 1950, Ch. 13) could be used. One should be cautious about 
naive acceptance of statistics relating selectors and performances as 
experienced in a given situation. 
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Table 1 

Cut Score and Percent Acc“_ 5 ted for Different Course Difficjilties 

and Z~, valuations of Outcomes 



Line No • 


Ev^aluation 


Difficulty of 
College Course 


G 

X 


'1 

!o 

Accepted 


( 1 ) 


Avoid Failure 


Easy 


1 

CD 


8o 


( 2 ) 


Avoid Failure 


Int e me di at e 


• 57 


28 


(3) 


Avoid Failure 


Hard 


1.97 


2 




Indifference 


Easy 


-lA 


92 


(5) 


Indifference 


Int ermediat e 


0 


50 


( 6 ) 


Indifference 


Hard 


1 A 


8 


(7) 


Detect Passer 


Easy 


-1.97 


98 


( 8 ) 


Detect Passer 


Int ermediat e 


-.57 


72 


(9) 


Detect Passer 


Hard 


.83 


20 
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Flgure Caption 



j<ig. 1. FoTjr gain (cost) regions for given c 



X 



and 



y 
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